Filtering Approximation Using Systematic Perturbations of a Discrete-Time Stochastic Dynamical System
نویسنده
چکیده
The standard problem of groundwater pollutant remediation by well pumping is modeled as a discrete-time LQG stochastic optimal control problem. The control is approximated by using a variation of differential dynamic programming (DDP) that includes systematic perturbations. Kalman filtering is used to estimate the partially observed state variables in a tractable format. This is a filtering application of the DDP method used by the authors in an earlier perturbation paper.
منابع مشابه
Systematic Perturbations of Discrete-Time Stochastic Dynamical Systems
The discrete-time stochastic optimal control problem is approximated by a variation of differential dynamic programming with systematic calculations of the perturbations due to small stochastic noise. This problem is related to the dual control aspects of stochastic optimal control problems. The motivation is to correct prior calculations for missing terms and to examine the foundations of the ...
متن کاملCombination of Approximation and Simulation Approaches for Distribution Functions in Stochastic Networks
This paper deals with the fundamental problem of estimating the distribution function (df) of the duration of the longest path in the stochastic activity network such as PERT network. First a technique is introduced to reduce variance in Conditional Monte Carlo Sampling (CMCS). Second, based on this technique a new procedure is developed for CMCS. Third, a combined approach of simulation and ap...
متن کاملDiscrete-time Stochastic Extremum Seeking
We present discrete-time stochastic extremum seeking algorithms and prove their convergence using stochastic averaging theory that we recently developed. First, we provide a discrete stochastic extremum seeking algorithm for a static map, in which measurement noise is considered and an ergodic discrete-time stochastic process is used as the excitation signal. Second, for discrete-time nonlinear...
متن کاملT-S FUZZY MODEL-BASED MEMORY CONTROL FOR DISCRETE-TIME SYSTEM WITH RANDOM INPUT DELAY
A memory control for T-S fuzzy discrete-time systems with sto- chastic input delay is proposed in this paper. Dierent from the common assumptions on the time delay in the existing literatures, it is assumed in this paper that the delays vary randomly and satisfy some probabilistic dis- tribution. A new state space model of the discrete-time T-S fuzzy system is derived by introducing some stocha...
متن کاملSpectral Filtering for General Linear Dynamical Systems
We give a polynomial-time algorithm for learning latent-state linear dynamical systems without system identification, and without assumptions on the spectral radius of the system’s transition matrix. The algorithm extends the recently introduced technique of spectral filtering, previously applied only to systems with a symmetric transition matrix, using a novel convex relaxation to allow for th...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2007